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BACKGROUND OF THE INVENTION 



a) Field of the Invention 

The invention is directed to a method and an arrangement in 
microscopy, particularly fluorescence laser scanning microscopy, for examination of 
predominantly biological specimens, preparations and associated components. This 
includes methods for screening active ingredients based on fluorescence detection 
(high throughput screening) and methods of laser scanning microscopy based upon 
other contrast mechanisms. 

b) [Prior] Description of the Related Art 

A typical area of application of light microscopy for examining 
biological preparations is fluorescence microscopy (Pawley, "Handbook of 
Biological Confocal Microscopy"; Plenum Press 1995). In this case, determined 
dyes are used for specific labeling of cell parts. 

The irradiated photons having a determined energy excite the dye 
molecules from the ground state to an excited state by the absorption of a photon. 
This excitation is usually referred to as single-photon absorption (Fig. la). The dye 
molecules excited in this way can return to the ground state in various ways. In 
fluorescence microscopy, the most important is the transition with emission of a 
fluorescence photon. Because of the Stokes shift, there is generally a red shift in the 



wavelength of the emitted photon in comparison to the excitation radiation; that is, it 
has a greater wavelength. Stokes shift makes it possible to separate the fluorescence 
radiation from the excitation radiation. 

The fluorescent light is split off from the excitation radiation by 
suitable dichroic beam splitters in combination with blocking filters and is observed 
separately. This makes it possible to show individual cell parts that are dyed with 
different dyes. In principle, however, several parts of a preparation can also be dyed 
simultaneously with different dyes which bind in a specific manner (multiple 
fluorescence). Special dichroic beam splitters are used again to distinguish between 
the fluorescence signals emitted by the individual dyes. 

In addition to excitation of dye molecules with a high-energy photon 
(single-photon absorption), excitation with a plurality of low-energy photons is also 
possible (Fig. lb). The sum of energies of the single photons corresponds 
approximately to that of the high-energy photon. This type of excitation of dyes is 
known as multiphoton absorption (Corle, Kino, "Confocal Scanning, Optical 
Microscopy and Related Imaging Systems", Academic Press 1996). Fig. lb shows 
excitation by means of simultaneous absorption of two photons in the near infrared 
wavelength region. However, the dye emission is not influenced by this type of 
excitation, i.e., the emission spectrum undergoes a negative Stokes shift in 
multiphoton absorption; that is, it has a smaller wavelength compared to the 
excitation radiation. The separation of the excitation radiation from the emission 
radiation is carried out in the same way as in single-photon excitation. 

The prior art will be explained more fully in the following by way of 
example with reference to a confocal laser scanning microscope (LSM) (Fig. 2). 

An LSM is essentially composed of four modules: light source L, 
scan module S, detection unit DE and microscope M. These modules are described 
more fully in the following. In addition, reference is had to DEI 9702753 Al and 
US6167173. 

Lasers with different wavelengths are used in an LSM for specific 
excitation of different dyes in a preparation. The choice of the excitation wavelength 
is governed by the absorption characteristics of the dyes to be examined. The 
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excitation radiation is generated in the light source module L. Various lasers A-D 
(argon, argon/krypton, Ti:Sa lasers) are used for this purpose. Further, the selection 
of wavelengths and the adjustment of the intensity of the required excitation 
wavelength is carried out in the light source module L, e.g., using an acousto-optic 

5 modulator. The laser radiation subsequently reaches the scan module S via a fiber or 

a suitable mirror arrangement. The laser radiation generated in the light source L is 
focused in the preparation (specimen 3) in a diffraction-limited manner by the 
objective (2) via the scanner, scan lens and tube lens. The focus is moved over the 
specimen 3 two-dimensional ly in x-y direction. The pixel dwell times when 

1 0 scanning over the specimen 3 are mostly in the range of less than one microsecond 

to several seconds. 

In confocal detection (descanned detection) of fluorescent light, the 
light emitted from the focal plane (specimen 3) and from the planes located above 
and below the latter reaches a dichroic beam splitter (MDB) via the scanner. This 
1 5 dichroic beam splitter separates the fluorescent light from the excitation light. The 

fluorescent light is subsequently focused, via dichroic beam splitters DBS 1-3 and 
pinhole optics, on a diaphragm (confocal diaphragm/pinhole) (PHI, 2, 3, 4) located 
precisely in a plane conjugate to the focal plane of the objective 2. In this way, 
fluorescent light components outside of the focus are suppressed. The optical 
20 resolution of the microscope can be adjusted by varying the size of the diaphragm. 

Another dichroic blocking filter (EF1-4) which again suppresses the excitation 
radiation is located behind the diaphragm. After passing the blocking filter, the 
fluorescent light is measured by means of a point detector (PMT1-4). 

When using multiphoton absorption, the excitation of the dye 
25 fluorescence is carried out in a small volume in which the excitation intensity is 

particularly high. This area is only negligibly larger than the detected area when 
using a confocal arrangement. Accordingly, a confocal diaphragm can be dispensed 
with and detection can be carried out directly after the objective, with reference to 
the detection direction, or on the side remote of the objective (non-descanned 
30 detection) via T-PMT, PMT 5. 
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In another arrangement (not shown) for detecting a dye fluorescence 
excited by multiphoton absorption, descanned detection is carried out again, but this 
time the pupil of the objective is imaged by the pinhole optics PH in the detection 
unit (non-confocal descanned detection). 
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From a three-dimensionally illuminated image, only the plane (optical 
section or slice) coinciding with the focal plane of the objective is reproduced by the 
above-described detection arrangements in connection with corresponding single- 
photon absorption or multiphoton absorption. By recording a plurality of optical 
slices in the x-y plane at different depths z of the specimen, a three-dimensional 
image of the specimen can be generated subsequently in computer-assisted manner. 

Accordingly, the LSM is suitable for examination of thick 
preparations. The excitation wavelengths are determined by the utilized dye with its 
specific absorption characteristics. Dichroic filters adapted to the emission 
characteristics of the dye ensure that only the fluorescent light emitted by the 
respective dye will be measured by the point detector. 

According to the prior art, line scanners, as they are called, are also 
used instead of point scanners (Corle, Kino, "Confocal Scanning Optical Microscopy 
and Related Imaging Systems", Academic Press 1996). The basic construction 
essentially corresponds to that of an LSM according to Fig. 2. However, instead of a 
point focus, a line is imaged in the specimen (3) and the specimen to be examined is 
scanned in only one direction (x or y). The line focus is generated by means of at 
least one cylindrical lens ZL (shown in dashes in Fig. 2) in the collimated 
illumination beam path, a pupil plane of the microscope arrangement being located 
in the focal length of the latter. In a construction of this kind, a slit diaphragm 
instead of a pinhole diaphragm PH 1-4 is used as confocal diaphragm (PH). Non- 
descanned detection can also be carried out with this arrangement when using 
multiphoton absorption. In this connection, the confocal diaphragm (PH) can be 
omitted again. A CCD camera (non-descanned) or line (descanned) with 1024 or 
more image points can be used for detection instead of the point detector (PMT). 
The image acquisition rate can be substantially increased by scanning a line instead 
of a point. Therefore, this scanning method can be used for observing high-speed 
processes in real time (real time microscopy). 

It is disadvantageous in this method that the depth resolution through 
the slit diaphragm is reduced by a factor of 1 .4 compared with point-scanning laser 
scanning microscopes. This is due to the fact that the confocal slit diaphragm 
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suppresses only fluorescent light components outside of the confocal section at right 
angles to the scan line. Lateral resolution is also worse. 

In another arrangement for real time microscopy according to the 
prior art, the entire field to be examined is illuminated by an expanded light source. 
However, only special point patterns of the total field to be scanned are uncovered 
by a rapidly rotating disk. These methods are mostly known in technical literature as 
Nipkow disk methods (Corle, Kino, "Confocal Scanning, Optical Microscopy and 
Related Imaging Systems", Academic Press 1996). 

In another method according to the prior art, known as structured 
illumination (see Fig. 3), the modulation depth of the optical imaging of an 
amplitude structure (e.g., grating) is used as a criterion for depth of field. The image 
of the periodic structure is distinguished by the frequency of the modulation and the 
phase position (image phase) of the modulation. 

Various projection scenarios can be obtained by means of a phase 
shift of the structure at right angles to the optical axis. 

Generally, at least three phase images PB are required at 0°, 120° and 
240° in order to calculate depth-discriminated optical sections without stripes. 
These phase images (PB) are subsequently calculated to form a (confocal) optical 
section image in an image processor by the following formula: 



I sedan W = Const • M*>W) - I(x,\ 20°)) 2 + (/(x,l 20°) - /(*,240°)) 2 + (/(*,0°) - f(*,240°)) 2 , 

where I(x, angle) describes the intensity at the respective pixel in the corresponding 
phase image. 

It is simplest to carry our the recording of three or more phase images 
sequentially. In this connection, it is assumed that the specimen is not moved during 
the measurement of the images. The section images or section stacks which are 
calculated from the phase images in this way can be displayed subsequently on a 
standard PC and monitor by means of 3-D evaluating software. The spatial 
resolution along the optical axis depends on the wavelength of the light, the numeric 
aperture of the objective and the modulation frequency. For a detailed description of 
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the calculation algorithm, reference is had to T. Wilson, et al., "Method of obtaining 
sectioning by using structured light in a conventional microscope", Optics Letters 22 
(24), 1997. 

A further disadvantage in previous methods for real time microscopy 
consists in that multiple detection devices must be provided when a plurality of dyes 
are examined simultaneously. This heightens the requirements for data transfer and 
increases the cost of a device of this kind. Therefore, at present, only microscopes 
are used for sequential image display of different dye fluorescences. DE 19829981 
Al describes a method for changing the excitation wavelengths and/or the intensity 
during the scanning process. 

OBJECT AND SUMMARY OF THE INVENTION 

It is the primary object of the invention to provide a novel method by 
which the preparations can be imaged in real time and with high optical resolution. 

This object is met by [arrangements and methods according to the 
independent patent claims.] a method for depth-resolved optical detection of a 
specimen comprises the steps of providing a s canning movement over the 
specimen or at least a part of the specimen of a n illumination light distribution 
of at least one wavelength which is generated on or in the specimen, providing 
detection particularly of the light which is influenced ba sed on interaction with 
the specimen, especially fluorescent light and/ or reflected light and/or 
luminescent light and/or scattered and/or trans mitted light the illumination 
light having a modulation in at least one spati al direction, and carrying out the 
scanning movement and detection associated with the scanning with the 
scanning movement at least in a first and a secon d different phase position of 
the modulation and/or first and second frequen cy of the periodicity of the 
modulation and calculating at least one optical section image through the 
specimen or through part of the specimen. 

Further in accordance with the invention, an a rrangement for 
depth-resolved optical detection of a specimen, especi ally of the light of an 
illumination light distribution which is influen ced based on interaction with the 
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specimen, especially fluorescent light and /or reflected light and/or luminescent 
light and/or scattered and/or transmitted light c omprising means for 
illuminating the specimen with at least one wavele ngth, means for generating a 
relative movement between the specimen and illumination light, means for 
imaging the light influenced bv the sp ecimen on at least one detector, means for 
imaging a structure which changes in a spatially periodic manner in at least one 
dimension in different phrases and/or frequenc ies of the periodicity on the 
specimen and means for calculating at least one o ptical section image from the 
local information of the light influenced bv th e specimen. 

(Preferred further developments are indicated in the dependent 

claims.] 

The invention is particularly suited for use in applications requiring 
multiple fluorescences, since these can be recorded simultaneously and 
advantageously also with optical resolution comparable to a point-scanning LSM, 
but in real time. 

The method can be used in image-displaying microscope systems 
such as laser scanning microscopes for three-dimensional examination of biological 
preparations with an optical, spatial resolution of up to 200 nm and in analytic 
microscope systems such as fluorescence correlation spectrometers. 

Further, fluorescence detection-based methods for screening dyes 
such as in chip readers are included. These methods differ from the methods of laser 
scanning microscopy primarily in that the image field is appreciably larger. 

BRIEF DESCRIPTION OF THE DRAWINGS 
In the drawings: 

Fig. 1A illustrates in schematic form single pho ton absorption; 
Fig. IB illustrates multiphoton absorption in s chematic form; 
Fig. 2 illustrates a confocal laser scanning m icroscope (LSM); 
Fig. 3 illustrates structured illumination, a k nown method, in 

block diagram form; 

Fig. 4 shows a possible method flow chart; 
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Fifl. 5 schematically shows specimens dved bv different dyes in 
the scanning field which require different wavelen gths to excite fluorescence; 

Fig. 6 illustrates schematically that with respect to Fig. 5, the 
coding frequency and/or the coding phrases of the excitation scan line 
transfer(s) to the detected fluorescence in the reoperative region; 

Figs. 7A-D schematically show phase codin g realized in a possible 

arrangement; 

Fig. 8 shows schematically a line focus in a scan fi eld in which 
phase positions of the amplitude modulati ons are presented; 

Figs. 9A-C show a first arrangement of a structur ed illumination 

with single scan line; 

Figs. 10A. B show schematically a structured illu mination with 
single scan line and coding of the modulation phrase or modulation frequency; 

Fig. 11 illustrates schematically another arrangement where the 

optics is shown in the XZ plane; 

Fig. 12 illustrates schematically the detection d iagram of a CCD 
surface of the multispectral line scanner in the XZ plane; 

Fig. 13 schematically shows the construction of the electronics for 
detecting the signals with a line detector; 

Fig. 14 shows schematically the detection of the str ipe images 
quasi-simultaneouslv when using three lines; 

Fig. 15 schematically shows the optical construction of th e Fig. 14 

application in the XZ plane; 

Fig. 16A shows a special grating structure for th e quasi- 
simultaneous recording case; 

Fig. 16B shows a second arrangement for gener ating a double 

line focus; 

Fig. 17 is directed to a structural illuminati on with quasi- 
simultaneous multispectral excitation where a plurality of parallel excitation 
lines of different wavelengths are generat ed by dispersive element; 
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Fi g. 18 schematically shows the combina tion of a multispectral 
line scanner with structured illumination; 

Fig. 19 schematically shows a structure used in a n intermediate 
image plane which is arranged after the scann ers in the direction of the 
specimen in a punctiform speci men interaction; 

Fig. 20A schematically shows two plane wavefro nts in the XY 
plane for examination of macroscopic sp ecimens; 

Fig. 20B shows the corresponding signa l resulting along the scan 
line for a quadratic specimen interaction (two photon excitation); 

Fig. 21 graphically shows the specimen ion in teraction using a 
structured scan line in comparison to a homogeneous s can line, the interocties 

being identical in both lines; 

Figs. 22 A-D schematically show differe nt constructions for 

generating two partial beams; and 

Figs. 23 A and B schematically show laser scanning microscopes 
with arrangements for the interference of partial light beams which contain a 
light module. 

BRIEF DESCRIPTION OF THE INVENTION AND THE PR EFERRED 

EMBODIMENTS 

The object of the method for increasing spatial detection resolution, 
preferably in a method displaying images in real time, is a line-shaped excitation and 
detection of the excitation radiation and/or excited fluorescence reflected, scattered 
and/or transmitted by a specimen. For this purpose, a line focus of the excitation 
radiation is generated in the specimen by means of suitable optics which are 
described more fully in the following. Fig. 4 shows a possible measurement flow 
chart. A scan field with the line focus is shown on the left-hand side. The line focus 
can be displaced along the arrow by suitable auxiliary means (scanner mirror in one 
direction). The increase in axial and lateral resolution is carried out by means of a 
structuring of the line focus. The structuring is carried out by superposing the scan 
line with a periodic structure which is generated, for example, by a sine grating in 
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the beam path. With coherent illumination, a structure can also be generated in the 
specimen by means of the interference of two coherent partial beams (Wilson, 
W098/45745). At least two images with different phase positions of the periodic 
structure are recorded. In principle, the optical section can also be carried out by 
recording images with different modulation frequencies of the structure. 

The illumination of the specimen can be carried out with spatially and 
temporally coherent or incoherent illumination. For example, a spatially coherent 
laser light source can also be used by employing a diffusion screen or by arraying a 
plurality of individual foci in the specimen for an incoherent illumination. 

At least two phase images PB with image phases of, e.g., 0° and 180° 
are advantageously required when using an excitation wavelength for calculating an 
optical section image in the image processor. With n excitation wavelengths, n+1 
phase images are necessary. For one excitation wavelength, the signal emitted by 
the specimen has the following form along a scan line: 
r Sig (x) = C(x)cos(kx) + B(x), 

where C(x) contains the actual object information (e.g., the concentration and 
effective cross section of the dye or the local reflection coefficient) at position x 
inside the confocal optical section and along the line focus for the excitation 
wavelength and represents the sought for quantity. B(x) contains the object 
information outside of the confocal area. B(x) is not modulated, since the structure 
is not focused sharply outside the confocal area. The inverse modulation frequency 
of the structured excitation is represented by k. The above equation has two 
unknowns C(x) and B(x). To determine C(x), it is necessary to take two phase 
images. Let the phase images be designated by I|(x), i=0,l ,. . .n and characterized by 
a relative phase displacement of the modulation of i- Acp (image phases), where the 
following equation system results: 

/ 0 (x) = C(x) ■ cos(k ■ x) + B(x) 

/, (x) = C{x) ■ cos{k ■ x + Acp) + B(x) 

The sought for object information is given by solving the equation system for C as 
follows: 
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C(x) = L ^ • 

cos(A:*A<p)-cos(£-x) 

To determine C(x), two images with different modulation frequencies 

k 0 and k, can also be taken in an analogous manner. Let the frequency images be 

designated by Ii(x), i=0, 1 ,. . .n, so that the following equation system results: 

] 0 (x) = C(x) ■ cos(* 0 • x) + B(x) 

/,(*) = C(x) cos(A:, x) + B(x). 

The sought for object information is given by solving the equation system for C as 
follows: 

c( ,_ /,(*Wo(*) . 

cos(£, ■ x) - cos(fc 0 • x) 

C(x) can also be obtained by taking at least two images with different 
phases and frequencies of modulation. 

An optical section in at least one specimen plane is composed of this 
line-related object information and can be further processed according to the prior art 
to obtain at least one image of at least one image stack. 

When only one excitation wavelength is used and at least three phase 
images (e.g., with relative phase positions of 0°, 120° and 240°) are recorded, the 
algorithm for obtaining the object information explained according to the prior art 
(T. Wilson, et al., "Method of obtaining sectioning by using structured light in a 
conventional microscope", Optics Letters 22 (24), 1997) can also be applied in all of 
the arrangements described herein. 

When a plurality of wavelengths are excited simultaneously, the 
subsequent separation of the signals of the specimen is carried out by a special phase 
coding or frequency coding of the modulation structure for the different excitation 
wavelengths. In general, the quantity of phase images required for n simultaneous 
excitation wavelengths is n+1 . In this connection, different excitation wavelengths 
are separated from one another by a defined wavelength-specific position 
displacement of the modulation (coding phase) and/or a characteristic modulation 
frequency (coding frequency). The light emitted by the specimen (e.g., fluorescence) 
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which occurs through an interaction of the excitation light of the respective 
wavelength with the specimen then possesses the specific coding phase and/or 
coding frequency depending on the excitation wavelength and can accordingly be 
separated according to the algorithm which will be given in the following. 

Accordingly, when a specimen such as that shown in Fig. 5 is dyed by 
different dyes (1, 2, 3) in the scanning field which require different wavelengths (L,, 
L 2 , L 3 ) to excite fluorescence, the coding frequency (ft, f 2 , f 3 ) and/or the coding 
phases «>,, <|>2, to) of the excitation scan line transfer(s) to the detected fluorescence 
in the respective region (1 ,. . .n), see Figure 6. 

Preferably, all excitation wavelengths have the same coding 
frequency, i.e., one modulation frequency, but different coding phases. The 
following discussion is restricted to this case with phase coding, wherein a coding by 
means of modulation frequency is to be treated analogously and is the subject of the 
invention. 

For two excitation wavelengths, the signal emitted by the specimen 
has the following form along a scan line: 

I Sig ( X ) = C, O) • cos(jfc • x + A ) + 5, (x) + C 2 O) • cos(k x+ty 2 ) + B 2 (x), 
where C,(x) or C 2 (x) represents the sought for object information (e.g., the 
concentration and effective cross section of the dye) at position x inside the confocal 
optical section and along the line focus for the two excitation wavelengths. B,(x) or 
B 2 (x) contains the object information outside of the confocal area. B,(x) and B 2 (x) 
are not modulated, since the structure is not focused sharply outside the confocal 
area. <h and <t> 2 are the coding phases assigned to the respective excitation 
wavelengths, and k is the inverse modulation frequency (which is identical for both 
excitation wavelengths in this example) of the structured excitation. The above 
equation has four unknowns d(x), B|(x), C 2 (x) and B 2 (x). 

To determine C,(x) and C 2 (x), it is necessary to take three phase 
images. Let the phase images be designated by I f (x), i=0,l,. . .n and characterized by 
a relative phase displacement of the modulation of iAAcp (image phases), where the 
following equation system results: 

/„ (x) - C, (jc) • cos(& • x + 4> x ) + 5, (x) + C 2 (x) • cos(fc • x + <|>, ) + B 2 (x), 
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/, (x) = C, (x) • cos(* • x + 4> x + A<p) + B, (x) + C 2 (x) ■ cos(k ■ x + <p 2 + Acp ) + B 2 (x), 

[ 2 (x) = C, (x) ■ cos(fc x + + 2 ■ A<p) + 5, (x) + C 2 (x) ■ cos(* ■ x + <f> 2 + 2 • Acp ) + B 2 (x). 

The sought for object information is given by solving the equation 
system for Ci and C 2 as follows: 

C, (x) = [-c 12 (x) • (7 2 (x) - / 0 (x)) + c 22 (x) • (/, (x) - /„ (x))] / det(x) 
C 2 (x) = [c, , (x) • (/ 2 (x) - 7 0 (x)) + c 21 (x) • (7, (x) - h (^))] / det(x), 
where c„ (x) = cos(^ • x + <j> i + i ■ A<p) - cos(k -x + tyj) 
and det(x) = c u (x) • c 22 (x) - c 12 (x) • c 21 (x) . 

Thus, in order to obtain the object information, the coding phases (<|>i) 
and the inverse modulation frequency (k) for the individual excitation wavelengths 
must be known. In order to solve the equation system and accordingly to separate 
the object information which was made visible by the respective excitation 
wavelength, three phase images are required in the case of two-dye excitation, 
wherein the image phase displacement (A(p) between the individual images is 120° 

in the simplest case. 

The object information from outside the confocal area can only be 
obtained for the sum of the amounts of all exciting wavelengths. In the present 
example, this background is: 

B, (jc) + B 2 (x) = 7 0 (x) - C, (x) • cos(k • x + (f>, ) - C 2 (x) • cos(£ • x + $ 2 ) 

which can be calculated when Ci and C 2 are known. 

Expansion to three excitation wavelengths is given in equivalent 
manner from the solution of the corresponding equation system, where C 3 (x) or 
B 3 (x) represents the object information excited by the third wavelength from inside 
or outside the confocal section. The object information for the individual 
wavelengths is given as follows: 

C, =[c n c 2} -c„ c 22 ) (/ 3 -/ 0 ) + (c 13 -c 32 -c l2 c 33 )-(/ 2 -/ 0 ) + (c 22 c 31 -c 23 c 32 ) (/, -/ 0 )]/det 
C 2 =[(c„ c 2 , -c u •cJ-(/ 1 -/ t ) + (c ll -c„ -c„ c 31 ) (/ 2 -/„) + (c M c 3l -c n • C „) (/ 1 -'„)]/det 
C, =[c„ c 22 c 12 -c 21 )-(/ 3 -/ 0 ) + (c 12 c 3l -c„ c 32 ) (/ 2 -/„) + (c 21 c 32 -c 22 -c sl H'i -^o)l /det 
with c()3(x) as coding phase of the modulation in the third excitation wavelength and 
det(x) = c„ • (c 22 • c 33 - c 23 • c 32 ) + c n ■ (c 23 • c 31 - c 21 • c 33 ) + c 13 ■ (c 21 • c 32 - c 22 ■ c 3) ). 
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With a three-dye excitation, four phase images are necessary for 
separating the object information, excited by the individual wavelengths. The image 
phase step size can be 90 degrees, for example. Since the values Cij are constant for 
an arrangement with predetermined coding phases and coding frequencies, obtaining 
the object information by signal processing is a simple operation. This operation can 
be indicated by the transformation of the scaled image signals AIj(x)=Ii (x)-Io(x) by 
means of factors f k (x) which are stored as constants and which are given by c f j(x). 
For three wavelengths, the equations above give, e.g., 
C, =fj A AI 3 +f 2 A AI 2 +fi A AIi 
C 2 =f4 A AI 3 +fs A AI 2 +fs A AT, 
Cj =f 7 A AI 3 +f 8 A AI Z +f 9 A Alt 

By way of generalization, it is necessary for simultaneous excitation 
with n wavelengths to take n+1 images Io to I n , each with its own phase and/or 
frequency of excitation modulation. Phase images (image phase: <pi) with phase 
coding of the excitation wavelength ((fc) give the following images which contain the 
image information of the pseudo-confocal section (Cj) and of background (Bj), 
which image information is excited by the respectivej'th wavelength: 



/ 0 W = Z C J W ' cos( * ■x + <f>j+<P 0 ) + B i (x) 
7=1 

/ ( ( X ) = jh Cj (x) ■ cos(k ■ x + <pj + cp , ) + Bj (x) 



h ( x ) = Z c j w ■ cos( ^ ' x + h + <p2 } + Bj (x) 



I n ( X ) = J Cj (x) • cos(k -x + fij+y^ + Bj (x) 

The resulting equation system having the following form 
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^12 



-22 



\ C nl C nl 



c 



where Cij(x) = cos(k A x A + <pO - cos ( k A x + 

can be solved for the sought for image information from inside the pseudo-confocal 
section separately according to the individual excitation wavelengths by known 
mathematical methods (e.g., Cramer's rule). 

Further, the image information from outside the pseudo-confocal 
section that is excited by all wavelengths can accordingly be determined according to 
the following equation: 

£ Bj (x) = /„ (x) - £ Cj (*) ■ cos (* • x + *J +( Po) • 

Analogous relationships apply when the frequency is used, instead of 
or in addition to the phase, for coding the various wavelengths and/or images. The 
coefficients Cy are suitable for modification. 

The coefficients c u can be determined by the measurement methods 
described in the following, regardless of whether phase and/or modulation frequency 
are/is used for image coding and wavelength coding, respectively. The coding 
frequency and the coding phase are determined (e.g., by means of a test object such 
as a glass plate or a mirror) for a reference wavelength (for example, 488 nm) for 
purposes of calibration. For this purpose, the periodic structure is imaged on the test 
object and measured by the detector, and the coding frequency and coding phase are 
measured and accordingly determined for a fixed image phase at the location of the 
specimen. The coding phases and coding frequencies of the other wavelengths can 
now be measured relative to this reference for a fixed image phase. In a possible 
arrangement, the phase coding is realized by dispersion (parallel offset) in a plane- 
parallel plate P which simultaneously serves as a support for an amplitude grating 
(structure S) arranged in front of it in the illumination direction (see Fig. 7A). A 
slight, wavelength-dependent parallel offset in the plane vertical to the axis of 
rotation and to the optical axis results when polychromatic excitation light passes 
through the plane-parallel plate P which is inclined slightly about axis A 
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(inclination: y; thickness: d): 

Ax(A) = d ■ (sin y - cosy ■ tan 0(X)), where /9(A) = sin -1 ((sin y)ln{X)). 

When the plate is located in an intermediate image plane (see Fig. 
9 A) of the microscope arrangement, this offset is expressed as the phase shift 
between the amplitude modulations of the individual excitation line foci. Fig. 8 
shows schematically a line focus in a scan field, in which the phase positions of the 
amplitude modulations for, e.g., three different excitation wavelengths are shown on 
the right-hand side of the diagram. The x-axis of the diagram corresponds to the 
coordinate along the line focus. Only a section of the scan line is shown on the 
right-hand side of Fig. 8 to illustrate the coding phases. 

A phase displacement of 5 degrees is sufficient for reliably separating 
the signals excited by the corresponding wavelength. Table 1 shows the coding 
phases for a concrete example. 

Table 1 : Phase displacement for important laser lines by dispersion in a BK7 plate 
having a thickness of 10 mm with an amplitude grating of 50 lines/mm. The plate is 
inclined by 5 degrees relative to the normal; for the reference wavelength of 488 ran, 
this gives a parallel offset of approximately 300 um relative to the optical axis. 



Wavelength 
(nm) 


Relative 
offset (nm) 


Phase displacement 

for 50 lines/mm (degrees) 


458 


1.08 


19.5 


476 


0.36 


6.5 


488 


0 


0 


514 


-0.56 


-10.1 


532 


-0.82 


-14.8 


543 


-0.95 


-17.1 


633 


-1.47 


-26.5 


1064 


-2.75 


-49.5 



An arrangement for wavelength-dependent phase displacement (phase 
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coding) uses an optical grating which is inserted in a pupil plane of the microscope 
arrangement, for example, in the scanner. 

Advantageous arrangements for fluorescence and DIC image display, 
for example, are described in the following without restrictions with regard to 
transferability to other optical contrast methods. 



Arrangement 1: Structured illumination with single scan line 

A first arrangement is shown in Fig. 9. The pupil beam path of the 
microscope arrangement is shown in dashes. The object beam path is indicated by 
solid lines. In Fig. 9A (xy-plane), light from the light source (LQ) is shaped into a 
line focus in an intermediate image plane (ZB), for example, by a cylindrical lens 
(ZL), the pupil plane of the microscope arrangement being located in the focal length 
of the cylindrical lens (ZL). An element (ST) which produces an amplitude 
modulation along the scan line is located in an intermediate image plane in front of 
or behind the cylindrical lens (illustrated in front of the cylindrical lens). This 
element ST is a transmission grating, for example. As is shown by way of example 
in Figs. 7B/7D, the change in periodicity runs in the X-direction at right angles to 
direction (Y) of the grating lines which are shown schematically as black bars. A 
displacement in this X-direction, for example, with the positioning unit PE as is 
shown in Fig. 9, enables a change in the phase position. A displacement of the 
structure according to Fig. 7D in the Y-direction (displacement not shown) results in 
a variation of the frequency of the amplitude modulation for adapting the optical 
section thickness (see the following) or for changing the modulation frequency 
during the recording of the individual images for calculating the optical section 
image. Tilting around a center of rotation located in the optical axis and an axis of 
rotation in the Y-direction likewise generates this displacement. A rotation of the 
grating about an axis of rotation in the Z-direction, which coincides with the optical 
axis, for example, likewise generates (see Fig. 16) a phase displacement which has 
different results when imaging a plurality of spatially separate lines on the specimen 
(line running in X-direction). 
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The structured scan line is subsequently imaged in the specimen (PR) 
via a main beam splitter (MDB) and a scanner (y), which moves the scan line 
vertical to the line (y-coordinate) and is again located in a pupil of the microscope 
arrangement, by means of the scan optics (SO), the tube lens (TL) and the objective 
(O). The relay optics (RL) image the focal point of the cylindrical lens (ZL) on the 
scanner (y). In special arrangements according to the prior art, the relay optics can 
also be dispensed with. For example, they can be omitted when the distance is 
shortened between the two scanners x and y or when the scanners x and y are 
replaced by a gimbal-mounted individual scanner. In principle, the cylindrical lens 
can also be replaced by a cylindrical mirror whose focal point lies on the scanner 
(X). The cylindrical mirror is arranged at 45° in the xz-plane shown in Fig. 9C. In 
this plane, the mirror also has a focusing effect. Further, the beam path is angled by 
90° to the light source by the mirror. This is shown schematically in Fig. 9C. 

The emission light collected by the objective (O) is split from the 
excitation light, for example, by means of the main beam splitter (MDB). 
Subsequently, the light from the specimen is focused by means of imaging optics 
(PO) with confocal detection through a slit diaphragm (SB) (slit position in 
longitudinal direction in Z-direction in the drawing), so that fluorescence occurring 
outside of the focus is suppressed. With non-descanned detection, the diaphragm 
can be omitted. A line detector or surface detector (DE) (position of line in Z- 
direction) is located behind the slit diaphragm and detects the fluorescence in a 
spatially resolved manner (along the line focus). In addition, an emission fdter (not 
shown) can be provided for suppressing the excitation radiation in the detection 
beam path after the main beam splitter (MDB). The line focus is scanned in one 
spatial direction by the galvo-scanner (y). If the x-scanner is not used for adjusting 
the image phase, it stays in its zero position. 

Fig. 9B shows the same arrangement, but mirrored by 90 degrees 
(YZ-plane). Instead of a line on the specimen, a focus point is shown on the 
specimen in this spatial direction due to the cylindrical lens (ZL) which is not 
effective in this direction. 

In principle, the slit diaphragm can also be omitted. This is useful, 
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above all, when the imaging of the fluorescence is not descanned via the scanner but 
is to be carried out directly on a CCD camera or a gated camera for spatially resolved 
measurement of the fluorescence lifetime (LaVision, Picostar). The CCD camera 
sees an intermediate image plane ZB, e.g., in the intermediate image plane between 
the TL and SO of the microscope arrangement. In a microscope according to the 
prior art, it is connected to a TV port (Fig. 19, TV port position). In addition, a CCD 
camera can be used in the transmission beam path of the microscope arrangement 
(e.g., Fig. 1 instead of T-PMT). The excitation radiation transmitted by the 
specimen can accordingly be detected with confocal resolution. In addition, 
confocal DIC imaging is also possible. For this purpose, according to the prior art, 
the DIC prism is arranged in the objective pupil between TL and objective O. 
Further, the image obtained in this way by DIC can be superposed with the images 
that were generated by signals reflected, scattered and/or emitted by the specimen to 
form one image. The calculation of the confocal section is carried out, for example, 
by taking at least two phase images (see Fig. 4 or the following text). The 
illumination intensity of the lines in the at least two phase images varies periodically 
- for example, sinusoidally - in x-direction due to the structure ST. The relative 
image phase when using three structured lines is displaced by 120-degree phases. 
The three phase images are generated in sequence, i.e., three images are scanned 
successively by means of the y-galvo-scanner (y). The structure (ST) can be a 
transmission grating, for example. The displacement of the image phase can be 
carried out, for example, with a positioning unit (PE) to which the transmission 
grating is coupled, so that every location of the specimen to be examined can be 
observed with varying brightness. Further, the adjustment of the image phase can be 
carried out as in Fig. 7A with a wavelength by means of a plate (PL) which is 
mounted in rotatable manner, the structure being arranged in front of the latter or 
impressed on it. The plate is to be arranged for this purpose in an intermediate 
image plane of the microscope arrangement as is shown in Fig. 9. The plane-parallel 
plate used for this purpose is located in an intermediate image plane; the structure 
ST (shown in Fig. 7B) is preferably arranged directly on the plate. 

In another arrangement, the adjustment of the image phase can also 
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be carried out by means of another galvo-scanner (X). The scanner (X) adjusts the 
image phase by displacing the scan line in x-direction. This has the advantage that it 
enables switching between a point-scanning LSM and a line-scanning LSM with 
structured illumination by inserting (swiveling in or sliding in) the cylindrical lens 
(ZL) and the transmission grating coupled with a detection-side beam deflection for 
switching from a point detector to a line detector (DE). If the scanner X is not used 
for adjusting the image phase, it stays in its zero position (i.e., is switched off). 

Arrangement 2: Structured illumination with single scan line and coding of the 
modulation phase or modulation frequency 

A second arrangement uses different coding phases depending on the 
excitation wavelength used in the structuring of the scan line. The signals of the 
fluorescence excited by the individual wavelengths can accordingly be digitally 
separated. Fig. 10A schematically shows a possible construction in the XZ-plane. 
Light of different wavelengths from the light source (LQ) undergoes amplitude 
modulation by means of a structure (ST). The structure is located in an intermediate 
image plane of the microscope arrangement. The structure is arranged so as to be 
displaceable via a positioning unit (PE), so that the structure can be displaced along 
the scan line and different image phases can be adjusted. Subsequently, the 
structured light is shaped in cylindrical optics (ZL) to form a line in the pupil plane 
of the microscope arrangement. For this purpose, the cylindrical lens (ZL) is 
arranged at the distance of its focal length from the pupil (scanner X). Further, the 
adjustment of the image phase can be carried out by the scanner (X) which is located 
in a pupil plane of the microscope arrangement. 

Fig. 10B shows a simplified arrangement with only one scanner (Y) 
in the XZ-plane. The adjustment of the image phase is carried out by the positioning 
unit PE. 

After an amplitude modulation has been impressed on the scan line, 
the radiation passes through an element in which the structure is displaced in a 
wavelength-dependent manner (ST) and the coding phase is accordingly varied in a 
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wavelength-dependent manner. A possible arrangement for phase coding was 
already described with reference to Fig. 7A. The plane-parallel plate used in this 
case is situated in an intermediate image plane; the periodic structure ST (shown in 
Fig. 7B among others) is preferably arranged directly on the plate. 

Following the phase coding or frequency coding of the amplitude 
modulation, the excitation radiation reaches the specimen via the main beam splitter 
(MDB), the Y-scanner, the scan optics (SO), the tube lens (TL) and the objective 
(O). The Y-scanner scans the scan line to record a phase image in the y-coordinate. 
The fluorescence excitation is carried out with the corresponding wavelengths 
depending on the dyes used. The modulation frequency and modulation phase of the 
scan line is transferred to the fluorescence signal in this way depending on the 
excitation wavelength. In descanned detection, the fluorescences are collected by 
the objective and arrive at the main beam splitter (MDB) via the tube lens, scan 
optics and Y-scanner. This main beam splitter (MDB) separates the fluorescence 
from the excitation radiation. Following this, the fluorescence is imaged on a line 
detector (DE) through a slit diaphragm. Additional blocking filters may be placed in 
front of the line detector to suppress the excitation wavelength. The slit diaphragm 
can be dispensed with particularly in multiphoton excitation. The separation of the 
individual signal components that have been generated by the various wavelengths 
and the calculation of the optical sections are carried out based on the algorithm 
described above, for example, using the coding phases at the same modulation 
frequency, wherein the coding phases of the individual wavelengths have been 
determined beforehand with test objects such as plane mirrors. Accordingly, regions 
which have been dyed with different dyes can be made visible separately. 

Another arrangement uses a dispersive element (DG), e.g., a 
transmission grating, which is located in a pupil plane of the microscope 
arrangement. The optics diagram in Fig. 1 1 is shown in the XZ-plane. The 
transmission grating displaces the individual scan lines within the drawing plane 
corresponding to their wavelength (only one WL shown). Accordingly, a different 
phase position of the modulation structure ST (coding phase) is impressed on the 
individual scan lines corresponding to their wavelength. The displacement of the 
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image phase is carried out by means of the positioning unit (PE) and the modulation 
structure S for every wavelength with identical step size. This ensures that the 
image phase displacement is 120° for every excitation wavelength, for example, 
when three phase images are taken. 

Advantageous arrangements for generating the frequency coding and 
adapting the optical resolution are described more fully in the following. 

The effective pinhole size, i.e., the optical section thickness for the 
individual wavelengths, can be adapted by changing the modulation frequency for 
every excitation wavelength. 

Fig. 7C schematically shows a device for wavelength-dependent 
adjustment of the modulation frequencies which is advantageously installed, instead 
of the structure ST, in arrangements 1 and 2 (as shown in Fig. 9, for example) in an 
intermediate image plane of the microscope device. In so doing, a polychromatic 
light source is spatially split into its spectral components by a dispersive element 
(DG1). Following this, the spectral components are made axially parallel with a first 
lens (lens 1, focal length f), i.e., DG1 lies in the focal point of the lens. The structure 
(ST) with which the amplitude modulation is carried out is located in the imaging- 
side focal plane. A possible construction of the structure with linear dependence of 
the frequency in y-direction is shown schematically in Fig. 7D. 

The splitting into lines LI, L2, L3 which is carried out according to 
Fig. 7C produces different modulation frequencies on this periodic structure through 
the different positions of the lines in y-direction. 

Thus, when a spatial splitting of the polychromatic light source is 
carried out with linear dependence on the wavelength, e.g., by a transmission 
grating, then, with a suitable grating design, the modulation frequencies of the 
individual spectral components also change depending on the wavelength. In this 
way it can be ensured, e.g., that the same optical section thickness is realized at 
different wavelengths. The individual spectral components are subsequently 
spatially superimposed again by means of a second lens (lens 2, focal length f, which 
need not be the same as the focal length of lens 1) and another dispersive element 
(DG2, e.g., transmission grating, which need not be identical to DG1). The beam 
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expansion can be controlled or monitored by adapting the focal lengths of lenses 1 
and 2 and the illumination of the microscope objective can accordingly be 
optimized. The following advantageous variants of the invention result from a 
structure of the kind mentioned above. 

a) A different change in phase can be generated in a defined 
manner (after prior calibrating measurement) for the individual lines by means of a 
displacement of the structure ST in x-direction, wherein, in the different phase 
positions, a complete scanning of the specimen by means of the respective line is 
carried out and wavelength-dependent section images are calculated. The section 
thickness can be changed by means of a defined shift in frequency by displacement 
in y-direction. 

b) By means of (at least one) displacement in y-direction, the 
modulation frequency is changed in a defined manner and section images can 
accordingly be calculated by repeated scanning at different modulation frequencies 
for the individual wavelengths. Further, a frequency coding and/or phase coding can 
be generated for different wavelengths via the different modulation frequencies of 
the structure with imaging of all wavelengths on a common line (see arrangement 4). 

Instead of the structure with continuous change in modulation 
frequency in y-direction which is shown in Fig. 7D, a structure (see also Fig. 16) 
which is composed of a plurality of partial structures of different modulation 
frequencies can be used. This has the disadvantage that the structure is adjusted only 
for fixed excitation wavelengths. However, in the simplest case, different gratings 
ST, each with a different modulation frequency, can also be swiveled into the 
arrangements 1 and 2. 

In another arrangement, not shown, the radiation, after structuring, 
passes an element in which the structure is increased in a wavelength-dependent 
manner, so that the modulation frequency varies in a wavelength-dependent manner, 
i.e., a frequency coding is carried out. In a first arrangement, the scan line is split 
into its individual wavelength components by dichroic beam splitters and a 
wavelength-dependent increase is subsequently impressed in the partial beam paths 
with a telescope having zoom optics for adjusting the increase. The individual scan 
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lines are superimposed again by means of additional dichroics. Alternatively, in 
another arrangement, special diffractive elements which generate a wavelength- 
dependent increase in the scan line can also be used. 

At the start, the scan line has a specific coding frequency of 
amplitude modulation depending on the wavelength that is used. The displacement 
in the image phase is carried out by means of the positioning unit (PE) and the 
displaceable structure ST for every wavelength with an identical step size. This 
ensures that the image phase displacement for each excitation wavelength is 120°, 
for example, when three phase images are taken. Instead of taking phase images, the 
optical section can be calculated from two images in which the modulation 
frequency is different per excitation line in the two images. The change in 
modulation frequency for all wavelengths or one wavelength can advantageously be 
carried out by taking the two images at different positions in the y-direction of the 
transmission grating according to Fig. 7D. 

It can be ensured by means of the arrangements described above, for 
example, that the axial optical resolution of the microscope is identical for different 
wavelengths. Accordingly, colocalization measurements are possible with a linear 
scanner. In addition, the effective pinhole can be increased, for example, in case of 
very weak fluorescence signals, by displacing the structure in y-direction, see Fig. 
7D, in this case, downward. While this reduces the optical resolution, the signal-to- 
noise ratio can be improved. 

In addition, the above-described zoom optics, not shown, serve to 
compensate for the chromatic longitudinal error of the imaging optics and, 
accordingly, to ensure that the optical slice is carried out in the same object plane. 
For this purpose, a lens of the individual zoom optics is misaligned slightly 
depending on the microscope objective employed, so that the beam for the individual 
wavelengths at the output of the zoom optics impinges divergently or convergently 
on the objective pupil and the focus can accordingly be shifted in axial direction 
depending on the excitation wavelength, i.e., made to coincide for all excitation 
wavelengths. 

In addition to constructions 1 and 2, another dispersive element (PR) 
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can be used for additional spectral splitting of the fluorescence signals vertical to the 
illumination line (multispectral line scanner). Fig. 12 shows the detection diagram 
of a CCD surface of the multispectral line scanner in the XZ-plane. The structured 
emission signals for the respective wavelengths are imaged in the x-direction of the 
detector (DE). 

The adjustment of the image phase can also be carried out in this case 
by the X-scanner as an alternative to the displacement of the phase position by 
means of PE. 

An image is taken for every scan position of the scan line, as is shown 
for different detection wavelengths. The freely programmable control of selected 
detector elements (lines) and the combination of detector elements of a column of 
the detector matrix allows a flexible selection of spectral regions of the fluorescence 
emission. For this purpose, a plurality of lines of the detector in which different 
fluorescence signals are imaged corresponding to their wavelength can be connected 
together electronically. The multispectral detection of the fluorescence emission can 
be combined again with the structured illumination. For this purpose, the line- 
shaped excitation is structured in addition, e.g., by means of a transmission grating 
(ST). In this connection, a complete scan process of the scan line is carried out by 
detecting the wavelength distribution corresponding to the imaging in Fig. 12 and 
further scanning processes are carried out by changing the image phase of the grating 
structure. Since a plane plate PL has been tilted in a defined manner, for example, 
for determining a wavelength-dependent offset, the change in phase position can be 
carried out, e.g., through displacement by PE at a constant tilting angle. The depth 
contrast can be optimized again by sequential detection of images of structured 
objects with different image phases of excitation and subsequent calculation. Fig. 12 
shows the combination of a multispectral line scanner (spectral splitting is carried 
out in the y-plane, that is, into the drawing plane) with structured illumination via 
the structure ST, wherein the phase coding is carried out again by a tilted plane- 
parallel plate (not shown) which is displaced vertical to the optical axis or by a 
dispersive element (see above). The image phase is varied sequentially. The 
different spectral components are detected in parallel by means of CCD arrays. 
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The slit diaphragm (SB) which serves in this case as an entrance slit 
for the spectral splitting can be omitted in case of descanned detection in the line 
scanner. While this reduces spectral resolution, it considerably simplifies apparatus 
because, otherwise, displaceable individual slit diaphragms would have to be used. 

Fig. 13 shows schematically the construction of the electronics for 
detecting the signals with a line detector. For this purpose, signals of the detector 
Kl-N are amplified by means of a current- voltage converter (A) and are 
subsequently integrated (I) during the pixel holding time. After further amplification 
for level matching to an analog-to-digital converter (ADC), these signals are 
converted into digital signals in the ADC and are transferred to a computer (PC). 
Detection with a CCD matrix is known from the technical literature. 

Arrangement 3: Structured illumination with quasi-simultaneous recording of phase 
images 

The detection of the stripe images can also be carried out quasi- 
simultaneously in that a plurality of lines (e.g., LI, L2, L3), instead of one line, are 
imaged in the specimen in parallel, wherein the intensity structure (image phase) is 
displaced , e.g., by 120°, in a manner analogous to Fig. 4, for example, when using, 
e.g., three lines (Fig. 14). Accordingly, all of the information for evaluating the data 
is generated already in the one-time scanning of the specimen. Fig. 15 schematically 
shows the optical construction in the YZ-plane. The focal points along the y-axis of 
the line foci are shown. The excitation light can be split by a beam splitter 
arrangement (T). Two embodiment forms of the beam splitter arrangement (T), 
which in this case is arranged in front of the cylindrical lens, are shown in Figs. 16A- 
B. The first arrangement, in cooperation with the cylinder lens, generates a plurality 
of discrete line foci with two mirrors arranged in parallel, wherein the first mirror is 
a full mirror and the second mirror is a partially transmitting mirror. The 
transmission of the partially transmitting mirror is adapted to every partial beam (i) 
and results from 1 00%/(n-l), where n is the total number of individual foci. 
Subsequently, the components (i) arrive separately in a special grating structure (ST) 
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which is shown schematically in Fig. 16 A. The partial gratings are modulated in this 
structure with a defined phase offset. Instead of the structure composed of partial 
gratings, a transmission grating according to Fig. 7B which is rotated as shown in 
Fig. 16A can also be used, so that the phase offset of the structure can be adjusted 
deliberately for the individual scan lines with identical modulation frequency in each 
instance. The calibration of the device, i.e., the determination of the modulation 
frequency and the phase positions of the scan lines, is carried out according to the 
method described above. The structure is located in an intermediate image plane of 
the microscope arrangement. The splitter arrangement can also be used, for 
example, in a pupil plane of the microscope arrangement. In this connection, both 
mirrors are tilted toward one another so that a plurality of line foci are formed again. 

The second arrangement in Fig. 16 (Fig. 16B) is a special 
arrangement for generating a double-line focus. The arrangement again uses two 
mirrors (SP1 and SP2) arranged in parallel, one of which mirrors (SP1) carries the 
structure ST itself. The structure reflects at the points of low transmission. The 
structure is arranged in the intermediate image of the microscope arrangement. Two 
lines whose amplitude modulations are in exactly opposite phase occur at the output 
of the splitter. The line 1 accordingly has an amplitude modulation that is exactly 
shifted by 180° relative to line 2. The structure is applied to glass plate 1. When a 
plurality of wavelengths are used, the wavelength-dependent parallel offset in y- 
direction is compensated through the plane-parallel glass plate by a second glass 
plate of the same thickness which is arranged at an angle of 90°. In addition, the 
entire splitter unit (T) is tilted slightly about the y-axis for generating the phase 
coding described above. A displacement of the structure (ST) can be dispensed with 
in both arrangements. The scanning movement of the Y-scanner is carried out over 
the image field actually being examined, so that every point on the specimen to be 
examined is illuminated once by a line of a di fferent phase position of the structure. 
This arrangement is particularly advantageous for examining rapidly changing 
specimens because movements or rapid changes in the specimen no longer have an 
interfering effect on the measurement and the maximum image recording speed of 
the line scanner is not reduced by the sequential data acquisition. The detection of 
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the lines which are excited in parallel is carried out with a matrix detector which, in 
the case of three lines, for example, is a three-line detector. Alternatively, a line 
detector on which all lines separated on the specimen are detected simultaneously 
can also be used. The separation of the information of every line can be carried out 
by means of the algorithm described above on the basis of different modulations (in 
phase and/or frequency) of every line. 
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Arrangement 4: Structured illumination with quasi-simultaneous multispectral 
excitation 

In a fourth arrangement, a plurality of discrete excitation wavelengths 
are formed so as to be spatially separated in different scan lines (e.g., with three laser 
lines: LI, L2, L3 in x-direction) in the specimen. For this purpose, a plurality of 
parallel excitation lines of different wavelength are generated (see Fig. 17) by a 
dispersive element (PR) (e.g., transmission grating, grating lines in x-direction) and 
are moved over the specimen by means of the y-galvo-scanner (y) and subsequent 
optical imaging in such a way that every point in the scan field under consideration 
is scanned at least once by every line. The optical construction is shown 
schematically in the YZ-plane in Fig. 18. The beam centroids of the line foci are 
shown in the drawing. 

The splitting of the fluorescence signals by the excitation is again 
carried out with the main color splitter (MDB). The fluorescence signals which have 
been generated by the different excitation lines arrive on different positions L1-L3 in 
z-direction of a matrix detector with slit diaphragms arranged in front of the latter in 
x-direction, wherein the axis at right angles to the illumination line corresponds to 
the corresponding wavelength of the fluorescence. The axis along the illumination 
line on the matrix detector corresponds to the spatial coordinate. 

In addition, a phase coding or frequency coding can also be carried 
out corresponding to arrangements 1 and 2. For example, for phase coding the 
structure (ST) is tilted about the Y-axis. Frequency coding can be carried out, e.g., 
with the special structure shown in Fig. 7D. When using a phase coding or 
frequency coding, the spectral components can again be detected simultaneously 
with a detector matrix which simultaneously detects all scan lines. In the simplest 
case, a CCD line with rectangular pixels (or joined lines) can be used for this 
purpose, the longer sides of the pixels advantageously being oriented in direction z 
(see Fig. 18), so that, for example, the scan lines LI to L3 are detected jointly by the 
detector line. The separation of the signals which have been excited by the different 
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scan line foci is then carried out again according to the algorithm described above. 
The advantage of these arrangements consists in that the individual scan lines need 
no longer be detected separately on a detector array, but can be detected by a one- 
dimensional detector. 

In addition, another dispersive element can be used for additional 
spectral splitting of the fluorescence signals at right angles to the illumination line. 
The detection scheme for the multispectral line scanner shown in Fig. 12 can be used 
for this purpose. A spatial coordinate is imaged in one direction of the detector. The 
freely programmable control of selected detector elements (lines) and the 
combination of detector elements of a column of the detector matrix allows a 
flexible selection of spectral regions of the fluorescence emission. For this purpose, 
a plurality of lines of the detector in which different fluorescence signals are imaged 
corresponding to their wavelength are joined electronically. The multispectral 
detection of the fluorescence emission can be combined again with the structured 
illumination. For this purpose, the line-shaped excitation is additionally structured, 
e.g., by means of a transmission grating. The depth contrast can again be optimized 
by sequential detection of images of structured objects with different image phases 
and subsequent calculation. Fig. 18 shows the combination of a multispectral line 
scanner with structured illumination. The image phase is varied sequentially with 
various structures. The different spectral components are detected in parallel by 
means of a CCD array, for example. According to the prior art, a plurality of freely 
movable diaphragms arranged conjugate to the individual scan lines had to be used 
in this arrangement as confocal slit diaphragms; however, these can be dispensed 
with due to the structuring of the scan lines. The expenditure on technical apparatus 
is considerably reduced in this way. 

Arrangement 5: Structured illumination with punctiform specimen interaction 

In a fifth arrangement, a punctiform excitation of the specimen is 
carried out instead of a line-shaped excitation of the specimen. For this purpose, the 
laser scanning microscope corresponding to Fig. 1 is operated according to the prior 



MARKED-UP/BOLDED SUBSTITUTE SPECIFICATION 



32 



art. However, a structure (ST) corresponding to Fig. 19 is used in an intermediate 
image plane which is arranged after the scanners x and y in the direction of the 
specimen. The structure is imaged successively in the specimen by scanning in the 
x-direction and y-direction. The recording of phase images is carried out by means 
of a displacement of the structure with the PE. In addition, a quasi-simultaneous 
illumination can be carried out according to arrangements 3 and 4. A phase coding 
or frequency coding with the arrangements described above is transferable without 
restrictions. The advantage of this arrangement over a conventional point scanner is 
that the signal of the specimen can also be measured without descanning directly 
with a CCD camera. In this case, the confocal diaphragm is also omitted. A gated 
camera (Picostar, La Vision), for example, can also be used as a CCD camera. 
Accordingly, for example, time-resolved fluorescence recordings of confocal optical 
sections can be achieved. According to the prior art, this is only possible through the 
use of nonlinear specimen interactions. 

However, a descanned punctiform detection or partially descanned 
detection (Stimson, et al., Rev. of Sc. Instr., (70), p3351, 1999) according to the 
prior art can also be carried out. 

Further, by means of the phase coding or frequency coding, the 
signals of the specimen excited by different wavelengths can be recorded 
simultaneously with the described detection variants. Only one detector is needed 
for this purpose. Accordingly, the construction of a laser scanning microscope can 
be decisively simplified by this arrangement without limiting flexibility. By 
switching on the structure, it is possible to switch back and forth between a 
conventional laser scanning microscope and a laser scanning microscope with 
structured illumination. 

A combination of methods 1-5 is likewise part of the invention. 
Further, a combination of the methods described above with parallel scanning 
methods according to the prior art is also possible without limitation. In these 
methods, a plurality of points or lines of identical intensity are imaged 
simultaneously as a matrix in the specimen (Buist, et al., J. o. Microscopy (192), 
p217, 1998; Nielsen, et al., J. o. Microscopy (201), P 852, 2000). In this way, image 
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recording rates can be further increased. Further, the specimen can be imaged by a 
table scanner or a scanner according to the prior art (e.g., Nipkow disk). 

The advantageous arrangements described above can also be used 
advantageously for examination of macroscopic specimens. Macroscopic specimens 
are used, for example, in screening active ingredients on a chip. The edge length of 
the scan fields amounts to several times 10 mm. These scan fields can be achieved, 
e.g., by increasing the scan angle of the galvo-scanner, by arranging the specimen in 
an intermediate image of the microscope arrangement, for example, in Fig. 2, or by a 
special objective arrangement (macro-objective) which images the intermediate 
image on the specimen in magnified manner. 

An arrangement for increasing the fluorescence signal in two-photon 
or three-photon excitation by a factor of 1.5 or 2.5 is described in Hell, et al., Journal 
of Microscopy, Vol. 202, Part 3, June 2001, 457-463. For this purpose, a parallel 
excitation of the specimen is carried out in a plurality of foci which are illuminated 
three-dimensionally by the multiplex method. The illumination patterns generated 
by interference are shifted spatially over a period and the signal is recorded in a 
time-averaged manner over this period. The aim of this arrangement is to increase 
the fluorescence signal in multiphoton excitation. This method has no influence on 
the spatial resolution, i.e., the optical resolution is achieved by the nonlinear 
interaction in the individual specimen points according to the prior art cited above. 

According to the invention, an interferometric superposition of at 
least two partial beams is used in this case for redistributing the average energy over 
the scan field to be examined. The redistribution of the average energy results in an 
increase in the fluorescence signal in multiphoton excitation. In addition, the 
interferometric superposition of the partial beams produces the above-described 
structuring of the scan line for increasing optical resolution. With the same 
fluorescence signal, the average output per specimen point can be reduced, so that 
there is reduced loading of the specimen to be examined. In addition, in comparison 
to the prior art, more specimen points can be examined simultaneously with the 
same output power of the laser, or lasers with lower output power can be used with 
the same quantity of specimen points. 
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The method according to the invention is accordingly particularly 
suitable for use in applications requiring a nonlinear specimen interaction, since they 
can be examined with reduced excitation intensity and, therefore, with less damage 
to specimens. 

The principle of the method described herein consists in that a laser 
beam is divided into at least two partial beams of identical power by means of beam 
splitters or by pupil division, wherein the wavefronts of the partial beams enclose a 
small angle of typically less than 5° relative to one another. The n-partial beams are 
subsequently superimposed interferometrically in one of the specimens, so that a 
periodic fringe pattern results depending on the adjusted angle. The intensity I M of 
the fringe pattern along the coordinate x (excitation) can generally be described as 
follows: 



^— - exp(- i • k ■ sin(#,. )• x 



(0) 



In this case, I 0 is the total intensity of the laser on the specimen which 
is split into equal parts on the n partial beams; 0j are the angles and &\ are the phase 
relationships between the partial beams with reference to an arbitrarily selected 
partial beam. 

Different projection scenarios of the structure can be obtained by 
means of a phase shift (by changing the phase relationships &0 of the structure 
vertical to the optical axis. The modulation frequency of the structured illumination 
is determined by the angles 0j. 

Fig. 20A shows two plane wavefronts in the X/Y plane - partial 
beams Tl, T2 of wavelength X which enclose an angle 9 relative to the optical axis 
of the arrangement and interfere with one another. 

A diffraction-limited periodic line-shaped intensity distribution 
results along X on the specimen by means of focusing in Y-direction, for example, 
through a cylindrical lens ZL in the specimen plane. Further, the line-shaped 
intensity distribution along X on the specimen can be carried out by diffractive or 
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When a nonlinear interaction with the specimen takes place, a 
detector measures the following signal S N resulting from the interaction: 

S N (x) = I M (x) N = [/ 0 * [l + cos(* • sin(0) ■ x + * )]]" , (2) 

where N is the order of nonlinearity. The corresponding signal S N resulting from 
this equation along the scan line is shown in Fig. 20B (2) for a quadratic specimen 
interaction N=2 (e.g., two-photon excitation), where I 0 =l is assumed without 
limiting generality. The modulation is periodic with period p. But the modulation is 
now asymmetric and oscillates between 0 and 4, since cos 2 (x) is asymmetric to 1 . 
This asymmetry increases for greater values of N. 

The signal Sn generated per period of intensity modulation is 
obtained by integrating the signal Sn(x) in x-direction: 
p 

S N = \l M {x) N dx, (3) 

o 

In comparison, the following specimen interaction results for a 
homogeneous distribution of the light intensity I 0 along the scan line in direction x: 

F N =)l 0 N dx = I 0 N .p (4) 

0 

Once again, Fig. 21 shows generally the specimen interaction using a 
structured scan line in comparison to a homogeneous scan line, the intensities being 
identical in both lines. The ratio S N /F N is shown as a function of the order of 
nonlinearity N. It will be seen that for N>1 , i.e., for a nonlinear specimen 
interaction, the ratio is greater than 1 . This means that at a constant average 
excitation intensi ty Io the efficiency of the specimen interaction increases through the 
use of a modulated line compared to a homogeneous scan line. In the case of a two- 
photon interaction, the efficiency is greater by a factor of 1 .5, for example. 
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Fig. 22 shows schematically different constructions for generating 
two partial beams. The object beam paths are shown in each case. A distinction is 
made here between generating the partial beams by dividing the microscope pupil 
(Figs. 22A and 22B.) and by using beam splitters (Fig. 22C). Splitting into two 
partial beams is carried out in a pupil plane of the microscope and in the xz plane of 
the microscope arrangement, i.e., in the. plane in which the scan line is generated. A 
division of the pupil is particularly useful when a plurality of wavelengths are used 
over a wide spectral range, since the energy distribution on the two partial beams is 
not dependent upon wavelength. However, it is disadvantageous when the beam 
profile of the light source is not homogeneous. In this way, an unhomogeneous 
modulation depth along the scan line can be brought about in the arrangements A 
and B. This is prevented by the arrangement in Fig. 22C. However, requirements 
regarding the spectral characteristics of the beam splitter are stricter in this 
arrangement. In general, it is possible to adapt the beam profile, e.g., through the use 
of diffractive elements and a combination with arrangements according to Figs. 22 A, 
22B or 22C. 

In Fig. 22A, light from the light source LQ which generates a 
collimated light bundle is transmitted through a Fresnel biprism FBP. The 
cylindrical lens ZL is located after FBP and acts in the plane vertical to the drawing 
plane and optical axis. As is shown in Fig. 22D, ZL can also be arranged in front of 
FBP without limitation. The splitting of the collimated beam of the light source into 
two partial beams of identical energy which enclose an angle 9 of typically less than 
5° is carried out by means of the biprism. The two partial beams intersect in an 
intermediate image ZB of the microscope arrangement. The line formed by the 
cylindrical optics ZL along the x-direction in the intermediate image is located in the 
xy plane. The drawing shows, by way of example, cylindrical optics ZL which focus 
the light of the light source LQ in the intermediate image ZB, i.e., the ZL stands at a 
distance exactly corresponding to the distance of focal length from the intermediate 
image. The partial beams reach the specimen through the following optics of the 
microscope arrangement (see Figs. 9, 10, 1 1, 12 and 23) via the scanners X and Y, 
the scan optics SO, the tube lens TL and the objective O. In the specimen, the two 
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partial beams overlap interferometrically and form a periodically structured scan line 
along the x-axis. The period of the scan line is dependent on the angle of inclination 
0 of the FBP (see Fig. 22A) and the wavelength of LQ. The image phase, i.e., %, can 
be deliberately adjusted by a rotation of FBP about the point of rotation DP in Fig. 
22 A. For a detailed description of the microscope arrangement and the method for 
generating the phase images and the calculation of the section images, reference is 
had to the preceding description. The advantage of variant A is that, by inserting 
FBP and ZL into the microscope beam path, a point-scanning laser scanning 
microscope can be reconfigured in a particularly advantageous manner to a 
microscope which scans in real time and in parallel manner. Further, the modulation 
frequency is highly dependent on the wavelength of the radiated light through the 
prismatic effect of FBP. This is advantageous especially for frequency coding (see 
above). However, the prismatic effect of FBP is problematic when using short pulse 
lasers with pulse lengths of less than 100 fs, since the individual spectral 
components of the laser pulses are imaged at different locations on the specimen and 
consequently can result in a widening of the pulses and therefore in a reduction in 
the pulse peak power. Fig. 22B therefore shows another advantageous arrangement. 
In this case, the splitting is carried out with a reflecting element such as a roof 
mirror DKS. DKS is arranged in the light source module (see Figs. 9, 10, 1 1, 12 and 
23) in such a way that the partial beams with identical energy intersect in ZB in the 
xz plane at an angle 9. ZL again focuses the LQ in the yz plane, so that a line is 
formed in ZB. By changing the angle between the two mirrors Ml and M2, e.g., by 
means of a piezo-actuator or a spindle pressing against M2 or Ml , the angle G 
between the two partial beams and, accordingly, the modulation frequency can be 
adjusted in a deliberate manner. In addition, an adjustment of the image phase £ can 
be carried out by a rotation of DKS about the axis of rotation DP shown in the 
drawing. The recording and calculation of the optical sections again take place in a 
manner analogous to the method already described above. 

In the arrangement according to Fig. 22C, two partial beams with 
identical energy are generated through the beam splitter BS - a partially transmitting 
plane mirror. This was described, for example, in DE 19904592 Al. However, in 
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this case, there is advantageously a cooperation with the element for shaping the 
line-shaped intensity distribution, e.g., by means of cylindrical lens ZL for 
generating a scan line. 

The partial beams subsequently pass via two mirrors Ml and M2 in 
direction ZB so that they intersect exactly in ZB in the xz plane. ZL again focuses 
the beam in the yz plane so that a line is formed along x in ZB. The angle 0 can be 
adjusted by the rotation of BS. The adjustment of the image phase & can be carried 
out by a displacement of Ml or M2 or by jointly displacing Ml and M2 at a constant 
distance. The recording and calculation of the optical sections is again carried out in 
a manner analogous to the preceding description. 

With regard to the complete arrangement of a microscope, 
particularly a laser scanning microscope, with the described arrangements for the 
interference of partial light beams, reference is had to the arrangements described 
above (e.g., Figs. 9, 19, 23) which contain a light module. 

While the foregoing description and drawings represent the 
present invention, it will be obvious to those skilled in the art that various 
changes may be made therein without departing from the true spirit and scope 
of the present invention. 
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ABSTRACT OF THE DISCLOSURE 

A method for depth-resolved optical detection of a specimen 
comprises the steps of providing a scanning movement over the specimen or at 
least a part of the specimen of an illumination light distribution of at least one 
wavelength which is generated on or in the specimen, providing detection 
particularly of the light which is influenced based on interaction with the 
specimen, especially fluorescent light and/or reflected light and/or luminescent 
light and/or scattered and/or transmitted light the illumination light having a 
modulation in at least one spatial direction, and carrying out the scanning 
movement and detection associated with the scanning with the scanning 
movement at least in a first and a second different phase position of the 
modulation and/or first and second frequency of the periodicity of the 
modulation and calculating at least one optical section image through the 
specimen or through part of the specimen. Other methods and arrangements 
are disclosed. 
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